A Hadoop cloud-based surrogate modelling framework for approximating complex hydrological models

نویسندگان

چکیده

Abstract Hydrological simulation has long been a challenge because of the computationally intensive and expensive nature complex hydrological models. In this paper, surrogate modelling (SM) framework is presented based on Hadoop cloud for approximating The substantial model runs required by design experiment (DOE) SM were solved using cloud. Polynomial chaos expansion (PCE) was fitted verified high-fidelity DOE then used as case study to investigate approximation capability in Soil Water Assessment Tool (SWAT) with regard accuracy, fidelity, efficiency. experiments, reduced computation time approximately 86% when global sensitivity analysis. PCE achieved results equivalent those standard Monte Carlo approach, flow variance coefficient determination 0.92. Moreover, proved be reliable approach but significantly more efficient. proposed greatly decreases computational costs through computing modelling, making it ideal optimization.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Hadoop Based Enhanced Cloud Architecture

Explosion of biological data due to largescale genomic research and advances in high throughput data generation tools result in massive distributed datasets. Analysis of such large nonrelational, heterogeneous, and distributed datasets is emerging challenge in data driven biomedical industries. Highly complex biological data require unconventional computational approaches and knowledge-based so...

متن کامل

Approximating nonequilibrium processes using a collection of surrogate diffusion models.

The surrogate process approximation (SPA) is applied to model the nonequilibrium dynamics of a reaction coordinate (RC) associated with the unfolding and refolding processes of a deca-alanine peptide at 300 K. The RC dynamics, which correspond to the evolution of the end-to-end distance of the polypeptide, are produced by steered molecular dynamics (SMD) simulations and approximated using overd...

متن کامل

A General Framework for Agent-based Modelling of Complex Systems

Agent-based approaches to modelling complex systems and phenomena are becoming popular and are proving successful in a number of areas. However, the underlying basis of these techniques is sometime rather 'ad-hoc' and the models are often only applied to specific systems. This paper describes a general approach that is based on the use of fully general computational models, using a formal model...

متن کامل

A framework for development and application of hydrological models

Many existing hydrological modelling procedures do not make best use of available information, resulting in non-minimal uncertainties in model structure and parameters, and a lack of detailed information regarding model behaviour. A framework is required that balances the level of model complexity supported by the available data with the level of performance suitable for the desired application...

متن کامل

A Query Processing Framework based on Hadoop

With the development of cloud computing and big data, the massive volume of dataset proposes a big challenge for cloud data management systems. Unlike traditional database management method, cloud data queries are typically parallel and distributed. Intuitively, the query processing framework should embrace these characteristics. In this paper, by leveraging the inherent data structure of Hadoo...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: Journal of Hydroinformatics

سال: 2023

ISSN: ['1465-1734', '1464-7141']

DOI: https://doi.org/10.2166/hydro.2023.184